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ABSTRACT 


A Wide class of signals may be conveniently descnbed m terms of time-dependent 
amplitude and frequency or sums of such amplitude and frequency-modulated 
components. However, the mam problem is the numencal estimation of these time 
dependent charactenstics Time-frequency representations offer a convement setup to 
estimate these parameters which tend to concentrate the energy density m disjomt regions 
of time-frequency plane Scalogram, the modulus square of contmuous wavelet 
transform, has been used as a time-frequency representation m the present work The 
local maxima of Scalogram, also known as ndges of the wavelet transform, contam 
crucial information on the charactenstics of the signal Indeed, they mark the regions of 
the time-frequency plane where the signal concentrates most of its energy Complex AM 
and FM signal models are mtroduced and their suitability to model speech phonemes has 
been studied, the parameters of which are estimated usmg Scalogram 
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CHAPTER 1 


1.1 Introduction 

In many engineenng applications such as speech analysis, speech synthesis, radar, 
sonar, telecommunications and engme diagnosis, the signals under consideration are 
known to be non-stationary, i e , their spectral contents vary with time Time-frequency 
analysis'’ among other methods, was proposed to deal with such signals Tune- 
frequency distributions (TFDs) are natural extensions of the Founer transform They map 
a one-dimaisional signal, to a two-dimoasional quantity, a function of time and 
frequency A concept mtimately related to TFDs is that of mstantaneous frequency (IF) ^ 
In many situations, the IF charactenzes important physical parameters of the signal 
Therefore, accurate and effective estimation of this quantity is of great importance 

An important challenge of time-frequency analysis is the case of multi-com.ponent 
signals In general, real hfe signals are non-stationary and multi-component The tune- 
frequency representation (also known as tune-frequency distnbution, TFD) characterizes 
such signals Several techniques have been proposed to reduce the effect of cross terms, 
which were inherent in any TFD The presence of cross terms obscures the time- 
frequency features of the signal TFDs concentrate the energy content of the signal in the 
time-frequency plane. Each such region m the time-frequency plane corresponds to a 
constituent component of the multi-component signal The idea is to get a distribution 
where each component can be separated from the rest which can be processed to extract 
the features of individual component Given a non-stationary signal vdiich has it’s energy 
localized in digoint regicms in the time- frequency plane, the mam task is to dexelop 
procedures that manipulate components in the diff^ent regions indqiendently In the case 
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of mono component signals, several ditnbutions' were proposed which charactenze the 
signal But for the case of multi-component signals, several TFDs fail due to the presence 
of cross terms 

For many years, the rqjresentation of a signal both m time and frequency domam has 
been of interest, especially when dealmg with time-varying non-stationary signals like 
speech signals, seismic signals and EEC’s The amplitude and frequency of such signals 
vary with time The most familiar representation is the spectrogram, which is, based on 
the assumption that for a short time basis, signals can be considered stationary Usmg this 
assumption spectrogram utilizes a short wmdow whose length is chosen so that over the 
length of the window a signal can be considered stationary Then Founer transform of the 
signal can be used to obtam the energy representation of the signal along the frequency 
direction at a given time, which corresponds, to the center of the window. The crucial 
drawback of this method is that the length of the window is directly related to the 
frequency resolution To increase the frequency resolution one must use a longer 
observation duration (i e , a longer window), which means that non-stationanti^ 
occurring dunng this interval are smeared m tune and frequency The main disadvantage 
with the spectrogram is that it presents a constant time-frequency resolution and events 
separated by larger than the wmdow length in time can not be effectively isolated. 

1.2. Motivation for taking up the problem 

A lot of work has been earned out m modelling non-stationary signals with 
varying degree of success The limitation of Founer transform in analyzing non- 
stationary signals 1 e., those signals whose spectral descnption depends on time led to the 
tools such as time frequency distnbutions For example. Short Time Founer Analysis 
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(STFT), Wigner Ville Distnbution (WVD), Ambiguity Function (AF) etc, aim at 
descnbmg time dependent spectral properties of signals, whereas time scale analysis, 
such as the wavelet transform aim at extracting localized contnbutions of signals which 
are labeled by scale parameter Wigner Ville Distribution (WVD) is very powerful for the 
analysis of mono component signals with linear frequency vanation. The mam drawback 
of WVD IS that It is bilinear m nature, mtroduang cross terms m the time-frequency 
plane, which makes the transform difScult to mterpret The wavelet transform is a time 
scale representation and is hnear by defimtion The scale parameter, which is mversely 
proportional to frequency, can be adjusted to obtam a time-frequency representation 
comparable to STFT and WVD It has been shown that STFT and WVD are very much 
similar, m that both are outputs of a bank of filters whose impulse responses are 

/z(/)e-'‘" and -^g(t/a) respectively In the case of STFT a bank of filters h(t)e^‘^ can be 
V<2 

considered as having constant bandwidth, since the wmdow length is fixed in most of the 
cases, hence the spectral and temporal resolution is fixed in these cases. In the case of 

wavelet transform, however, a bank of filters can be considered as a set of 

filters whose bandwidth is changing with frequency Since one can choose the scale 
parameter a which is inversely proportional to frequency, the wavelet transform provides 
high spectral resolution and low temporal resolution for low frequency Conversely for 
high frequencies, it provides high temporal resolution at the cost of spectral resolution 
Thus wavelet transform is a natural choice for the analysis of non-stationary signals 



1.3. Organization of the Dissertation 


This thesis is organized into a total of 4 chapters In chapter 2, tune frequency 
distnbutions are reviewed, and Scalogram, a member of Time-frequency distributions of 
affine class is introduced It has been studied thoroughly and subsequently how it can be 
used to extract the instantaneous frequency and amplitude of an analytical signal is 
presented The method descnbes how ndges of the wavelet magnitude charactenze 
completely the mformaton present in an analytical signal The techmque has been 
studied both for mono-component and multi-component cases In chapter 3, two novel 
models namely complex AM signal model and complex FM signal model are introduced. 
The Scalogram, which was introduced m the earlier chapter, has been used to estimate the 
parameters of the above models The suitability of the above models to fit voiced and 
imvoiced speech phonemes is earned out m the same chapter Chapter 4 concludes the 
whole work carried out and few suggestions are made for fixture work All the obtained 
results are attached nght after their mtroduction m every chapter 
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CHAPTER 2 


Time Frequency Distributions 

2.1 Introduction 

The power of standard Fourier analysis is that it allows the decomposition of a 
signal mto mdividual frequency components and establishes the relative mtensity of each 
component The energy spectrum does not, however, tell us when those frequencies are 
occurred It is m this context, the Short Time Founer Transform (STFT), or spectrogram 
IS mtroduced for the study of time-varying signals However, there exists natural and 
man-made signals whose content is changmg so rapidly that findmg an appropnate short- 
time window IS problematic smce there may not be any time mterval for which the signal 
IS more or less stationary Also, decreasing the time window so that one may locaffe 
events in time reduces the frequency resolution Hence there is an inherent trade of 
betv\een time and frequency resolution Although the motivation behind time frequency 
distributions is to improve upon the spectrogram, the mam idea is to find out means to 
anal\7;e and classify time varying spectra The basic idea that stemmed is to device a joint 
time-frequency function that will descnbe the energy density or intensity of a signal 
simultaneously in time and frequency 
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2.2. Scalogram 

The continuous wavelet transform (CWTj of a function x (t) € L^(R) is defined as 

oo 

T^{a,b) = < > = J x(t)(p\j,(t)dt 2 2 1 

The function (Pa,b represents a dilated and translated version of a basic function 
9(t) called mother wavelet a represents the scaling parameter of the wavelet, while b 

represents the dilation parameter The function (p(t) can be called wavelet provided it 
satisfies the following conditions 

• (p(t) should integrate to zero J (p(t)dt=0 


this suggests that wavelet should have oscillatory or wavy appearance 


(p(t) is square mtegrable or, equivalently , has finite energy J dt- 


9(t) should satisfy the admissibility condition 


i M 


Conditions 1 and 2 suffice to define a wavelet, whereas admissibility condition is to be 
satisfied in formulating a simple inverse wavelet transform 
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The Scalogram of a signal x (t) is dejhned as the modulus square of the wavelet 
transform. 


SC^ia,b)=T^{a,b)^ 


If (p(t) satisfies the conditions mentioned m Eq (2 2 2), one can associate to it a 
tune support interval T,p , centered at a time t© and a frequency support W(p , centered at a 
frequency COq,. 


oo 



V 


J {t — uf (p(t)^ dt 



2n 


J 


2 

(w— |<p(w)| dw 






J 


2.2 4 


Thus, (p(t) has time-frequency support centered at (t(p,CO<p). It has been found that 

complex morlet wavelet out performs'® among all other wavelets in localizing the energy 
of different components present m a multi-component signal Analytic wavelets are to be 
used to analyze the time evolution of frequency tones The analytic wavelet satisfiK 

^( W )=0 , W <0 225 

Complex morlet wavelet satisfies Eq (2 2 5) and it is defined as 

22 6 
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which IS a modulated gaussian function coq is a frequency parameter controILng the 
number of oscillations of the wavelet wrthm its gaussian envelope and a controls the size 
of the envelope It has been found that the morlet wavelet has a compact support of [-4, 
4] A Gaussian function is the most natural choice as it is the natural choice of a basic 
atom m tune-frequency plane 


2.3. Instantaneous Frequency 

Consider the monochromatic wave, which can be unambiguously represented by 

x(0 = a cosilnv^t) 2 3 1 

Where the constants a and vo are the amplitude and frequency respectively It is quite 
temptmg to extend this point of view to evolutionary situations, simply letting a vary m 
time, and by mtroducmg an argument with a time varying derivative This would lead to 

x{t)=a{t)cos(t){t) 23 2 

Unfortunately the above expression is not unique There are infinitely many pairs 
(a (t), ^(t)) for the representation of x (t) A proper solution can be obtained to the 
above problem by taking the analytic signal of x (t), which would be given by 

(f ) = a{t) exp(<^ (f )) 2.3 3 


s 



The analytic signal of x (t) is obtained by, 


(0 = x (0 + jH {x(0 } = X{t) + ^pv\ ds 234 

71 

Where H denotes the Hilbert transform The complexified signal Zx (t) is called 
the analytic signal The analytic signal admits a simple interpretation m fi’equency 
domam By definition, we get 

(v) = X(v) + j{-j sgn v)X (v) = 2 U{y)X (v) 235 

The real signal x (t) given by Eq (2 3 2) belonging to L^(R) with a (t) > 0 and 
(p(t) e [0, 2 %), t e R, is said to be asymptotic if 


dt 


» 


1 da 
a dt 


2.3.6 


Which means that the oscillations coming fi'om the phase term are much faster than the 
vanation of amplitude If Eq (2 3 6) is satisfied, then we can approximate the analytic 
signal of Eq (2 3 2) to the form, 

Z^(/')==a(r)e^'^^'’ 2 . 3.7 


The above analysis applies to each component of the analyzed multi-component signal 
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2.4 Estimation of Instantaneous Frequency and Amplitudes 

Consider a mono component signal of the form 

x{t) =A(t) COS 2 4 1 


Let <|)(t) represmt an analytic wavelet, i e of the form, 


v(f) = 2 42 

Where g (t) is the gaussian function The analytic signal of the mono component signal 
given by Eq (2 41) is given by 

243 


The CWT of the signal given by Eq (2 4 1) can be obtained as the inner product of the 
analytical signal and mother wavelet. 


1 


T^{,a,b) = < >=-<Z^y ” gj „ > 


Under asymptotic condition^ of Eq (2 3 6), it can be shown that 


244 


TM^b) 



g[a{w-^^{b))]^£{b,w) 


245 


Where g(a)) is The Founer transform of g (t) and <Px^(t) is the time denvative of 

(p(t). The term E(b, (o) is an error term vdiich is negligible if A(t) and (px^(t) have small 
vanations over the support of (paj>- which is satisfied in most of the practical cases 
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Let coo IS the center frequency of the wavelet function q)(t) and co denote the center 
frequency of cpaa, Then frequency is related to the scale by 


CO 


_ ^0 


a 
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The normalized Scalogram is given by 


CO — . T{b,a)~ Wq 

— ^ •trx'y* — 






a 


for (£) —■ 


a 


lAl 


Using Eq (2 4 5), we get 


ffl . 1.2 


©n 


SC^(b,co) = -A;(b) 


f 




co^ 


V 


%(b) 


CO 




+ £(Z>, CD) 
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Smce g(©) IS maximum at ocr=0, neglecting E(b, ©), the Scalogram is maximum at 


a 


249 


The correspondmg points (b, 00 (b)) are called wavelet ndges Thus (o(b) over the ridge 
gives the instantaneous frequency of the signal The instantaneous amplitude of the 
analytical signal is given by 


Afh) = - 


ji 

l—SCfb,a?) 

(0, 


i(0) 


along the ndge 


2 4 10 


Thus ndge completely charactenzes the analytical signal 
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2.5.Finding the ridge 


Since jT (b, a)j is locally maximum on the ndge, the ndge can be tracked by finding 
the local maxima of the transform scale variable. Once the ndge is extracted the 
mstantaneous fi'equency and amplitude can be extracted as follows 

1 From the ndge, for each time b, corresponding to scale a, coo/a along the ndge 
represents the mstantaneous frequency 

2 The mstantaneous amplitude can be extracted usmg Eq (2 4 10) 

In the case of multi-component signals, if there is no overlap among the components, the 
following procedure is used to extract ndges 

1 Compute the wavelet transform of analytical signal Find out the transform 
magmtude 

2 Threshold the magnitude of the transform This suppr^ses the noise and cross terms 
when the regions are close 

3 Find out diflferent regions in the hme-fi'equency plane, which represent the 
components m the multi-component signal. 

4. Process each region masking the rest of the transform 

5 Corresponding to each ndge, find out associated instantaneous fi-equency and 
amplitude 

When the SNR is very low, the problem of choosing a proper threshold becomes cntical, 
the threshold may miss a component that gives a peak below the threshold The above 
method is found to be robust for estimation of instantaneous fi-equency even in the 
presence of noise The presence of noise degrades the estimation of instantaneous 
amplitude 
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CHAPTER 3 


Complex AM and FM Signal Models 
3.1 Introduction 

In real life, many signals, like speech, are non-stationary m nature Modelling of 
such non-stationary signals is rather a difficult task because of the inherent dependence of 
parameters of the model on time In many applications, one needs to represent a signal 
with a given model The parameters of the model are obtamed with the signal m such a 
way that the synthetic version of the signal is as close to the onginal one as possible It is 
in this context, two novel methods are proposed to model non-stationary signals It has 
been found that voiced speech phonemes can be modelled using Complex AM signal 
model^ whereas unvoiced speech phonemes can be modelled using Complex FM signal 
modef The estimation of the above model parameters is earned out using the 
Scalogram, the modulus of magnitude square of the continuous wavelet transform In this 
chapter each of the model is introduced and their suitability for modelling of speech 
phonemes is studied 
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3.2. Complex AM signal model 

The complex sequence x [n] consisting of M smgle-tone amplitude modulated 
(AM) signals is represented by 

M 

= + 32, 

J=1 

Where 

A, IS the earner amplitude of constituent signal, 

IS the earner angular frequency, 

/^, IS the modulation index 
h IS the modulating angular frequency and 

IS the mdependent and identically distnbuted(i i d) random phase which is 
assumed to be uniformly distnbuted over [0, 27t) 

The signal model represented by (3 2 1) is highly non-stationary and estimating 
the model parameters is not an easy task The method of Scalogram developed m chapter 
2 IS used to estimate the parameters of the above model Once the earner and modulating 
angular frequencies are determined from the time-frequency plot, the remaining problem 
of estimating amplitude and phases of each sub signal of the multi-component signal 
becomes a linear estimation problem as presented below 
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The discrete time signal x [n] fitted into the mode! of Eq (321) is reproduced 


below 


M 

4n] = + 


!=1 

The above equation can be equivalently written as 
M M 

1=1 1=1 

Where 

IS the unknown complex amplitude of the carrier, 

, IS the unknown modulation mdex, and 
P — 

bi ^ 5 S z ~ ^ are the parameters which can be computed from the 

estimated parameters of earner and modulating angular frequencies Rewntmg Eq 
(3 2 2) m matnx form, we get 


■ 40] 


41] 


a[2] 

= 

_a:[A-1]_ 



1 . 1 
^1 • • 


^1 




h\ * W 


1 

^iC, 


2^2 


^1 C, 


1 


hi S| - hAf hM 




A Mm 

L % , 


3 2,3 
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Eq (3 2 3) IS to be solved in the least squares sense to find complex earner amplitude and 
modulation mdex parameters The pseudoinverse of the matnx can be computed by a 
suitable decomposition technique like singular value decomposition (SVD) The 
estimation accuracy of earner amplitude and modulation index parameters directly 
depends on the estimation accuracy of the earner and modulating angular fi'equencies 


3.2.1. Simulation Study 

Consider the complex sequence {x [n], n=0, 1, 2 . N-1} consistmg of two smgle 
tone amplitude modulated sub signals The parameters of the synthesized signal are as 
listed below 

Ai = 1 0, wi = 0 35, Pi = 0 30, V, = 0 005, (jn = 7t/4 

Aa = 1 5, W 2 = 0 25, pa = 0 50, va = 0 015, (jia = 7t/6 

A 3 = 1 0, ws = 0 15, p 3 = 0 00, V 3 = 0 010, (j )3 = 71/8 

The Scalogram of the above multi-component amplitude modulated signal is 
shown m Fig 3 1 One can clearly identify the earner and modulating angular firequencies 
m the Scalogram plot The ndges of the Scalogram represent the earner and carrier plus 
modulating angular firequencies, which were found to be m comcidence with the above 
values Also firom the mstantaneous amplitude plots, earner amplitudes and modulation 
indices can be found Fig 3 3 represents the Scalogram of the above signal at 10 dB SNR 
and Fig 3 4 represents the Scalogram at 0 dB SNR It can be mferred that estimation of 
fi'equency parameters is robust to noise, whereas noise degrades the amplitude parameter 
estimation 
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It has been shown that voiced speech phonemes can be modelled using complex AM 
signal model^. 
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Fig. 3.5. Scalogram of Voiced Speech Phoneme /n/ 

Fig. 3.5 represents the Scalogram plot of voiced speech phoneme /n/. Looking at 
the plot, one can observe that it has only one amplitude modulated compon^t. The 
original and reconstructed plots of speech phoneme are plotted in Fig 3.6. 
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Fig 3 7. Scalogram of Voiced Speech Phoneme /a/ 

The above plot reveals that the voiced speech phoneme /a/ has two amplitude 
modulated earners and one unmodulated earner 
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3.3. Complex FM signal model 


The complex sequence x[n] consistmg of M single tone frequency modulated 
(FM) subsequences can be represented as 


M 

An]=Y,A 


l=\ 


^j(w,n+<j),+p,cos(v,n)) 


3 3 1 


Where 

A, IS the amplitude of complex exponential earner signal 
IS the earner angular frequency, 

A IS the modulation index 

V, IS the modulating angular frequency and 

IS the random phase independent and identically distnbuted(i i d) which is 

assumed to be umformly distnbuted over [0, 2n) 


The signal model given in Eq (3.3 1) is highly non-stationaiy and estimating the 
parameters of the model is not an easy task The method of Scalogram developed in 
chapter 2 will be used to estimate the parameters of the above model Once the earner 
and modulating angular frequencies, modulation indices are determined from the 
Scalogram plot, the remaining problem of estimating the amplitudes and phases of each 
sub signal of the multi-component signal becomes a linear estimation problem 
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Consider the complex sequence {x [n], n=0, 1, 2, N-1} given by Eq. (3 3 1) 

which IS reproduced below 

M 

^ gy(w,«+^,+AcOS(v,/!)) 

1=1 

This can be equivalently wntten as 

M 

1=1 


An]=Y, 


Where the complex amplitudes and the complex weights given below can be 
computed with the estimated parameters of earner, modulatmg angular frequencies and 
modulation mdices 




A 




K =e 


— cos(v,n)) 


333 


Rewnting (3 3.2) in matnx form, we get 


40 ] 

41 ] 


4V - 1] 


>^ 0 ,, <^ 0,2 
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Km 

Km 


K-u K-a ■ ■ K-i 


M 






34 
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Eq (3 3 4) should be solved m least squares sense by employing a suitable 
pseudoinverse of the complex weight matrix which will be over determined with N > M 
Note that the problem of solving Eq (3 3 5) depends directly on the estimation accuracy 
of the angular and modulation index parameters 


3.3.1. Simulation Study 

Consider the complex sequence {x [n], n = 0, 1, 2 N} consistmg of two smgle 
tone frequency modulated sub signals The parameters of the synthesized signal 
parameters are as listed below 

Ai = 1 0, Wi = 0 35, Pi = 0 10, vi = 0 02, (t»i = %IA 

A2 = 1 5, W2 = 0 15, p2 = 0.05, V2 = 0 01, ^2 = tiI6 

The Scalogram of the above multi-component frequency modulated signal signal 
IS shown m Fig 3 9 Clearly one can observe how the frequency is vaaymg m the 
Scalogram plot Fig 3 10 represents instantaneous frequency of individual components 

recovered from the ndges of the Scalogram The values of angular, modulatmg 

frequencies as well as modulation indices can be estimated from the ndges of the 
Scalogram, which were found to be in comcidence with the above values Now with the 
help of Eq (3 3 5), the complex amplitudes can be calculated Fig 3 11 represents the 
Scalogram of the above signal at 10 dB SNR Fig3.12 represents the Scalogram at 0 dB 
SNR It can be inferred that the effect of noise is mmimal on the estimation of frequency 
parameters where as amplitude estimation degrades heavily with the presence of noise 
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Fig 3 11 Scalogram of two component FM signal at 10 dB SNR 



It has been shown'^ that unvoiced phonemes can be modelled using complex FM model. 



Time 

Fig 3,13. Scalogram of unvoiced speech ptoneme /q/ 

From the scalogram of Fig. 3.13, one can clearly observe that the unvoiced speech 
phoneme /q/ has two frequency modulated components and three unmodulated earners. 
These parameters can be estimated from the instantaneous frequency plots, which were 
obtained from the ridges of the scalogram. 
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Fig 3 . 1 5 Scalogram of speech phoneme /v/ 

From the scalogram of Fig. 3.15, one can clearly observe that the unvoiced speech 
phoneme /q/ has three frequency modulated components and three unmodulated camas. 
These parameters can be estimated from the instantaneous frequency plots, which were 
obtained from the ridges of the scalogram. 
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Chapter 4 


CONCLUSIONS 

In this dissertation time frequency distnbutions were reviewed and scalogram, a 
time frequency distnbution of affine class has been extensively studied Morlet wavelet 
has been used to estimate the time varymg frequency and amplitude quantities of the 
multi-component signals It has been found that the ndges of the scalogram completely 
charactenze the components present in a multi-component signal, smce the time 
frequency representation tend to localize in disjomt regions m the time frequency plane 

Complex AM signal model has been found to be quite suitable for modelling 
voiced speech phonemes whereas Complex FM signal model has been found to be 
suitable for modelling unvoiced speech phonemes The simulations revealed that 
Scalogram technique is a powerful tool to analyze multi-component signals This method 
fails when the components present m the multi-component model overlap with each 
other Also it is has been found that the frequency estimation is robust to noise while the 
amplitude estimates are sensitive to noise 
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SUGGESTIONS FOR FURTHER WORK 


In the present work it has been established that voiced speech phonemes can be 
modelled using complex AM signal model, 'whereas unvoiced speech phonemes can be 
modelled using complex FM signal model Hence a combination of these two models can 
be used to model a continuous speech data Moreover the Scalogram techmque fails when 
there is significant overlap among different components in the time-frequency plane In 
that case, time frc<juency distributions that give more resolution m quadratic time- 
frequency plane are to be employed for separating the components 
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